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ABSTRACT 

The purpose of this project was to test the effect of 
an intensive acquisition effort in one region of the nation 
(Connecticut, Maine, New Haapshire, Rhode Island, and ?eriont| ; and 
develop selection criteria, indexing strategies, and abstract foraats 
congruent with user needs. The staff of The Center for Vocational and 
Technical Education (CVTE) was to develop the initial scope stateaent 
on which to base the acquisition of materials for the project. The 
New England Resource Center for Occupational Education (NEBCOE) was 
subcontracted to develop a sailing list of potential sources of 
■aterials and was to create in cooperation with CVTE, acquisition 
announceaents and request letters to 5,600 New England educators and 
various other sources. Further CVTE was to engage consultants to 
develop indexing strategies and abstract foraats, and to establish a 
panel who would set up the criteria on which to base material 
selection for input into the ERIC systea. Jointly CVTB and NEBCOE 
were to prepare the required progress, interia, and final reports. 
The findings presented are based on data collected through (1) 
tabulation of docuoent nuabers, (2) questionnaire and telephone 
interviews, and (3) selection d€;Cision records. The conclusions and 
recoaaendations are presented in detail through tabulated charts and 
in the various aaterials appended. (Author/BP) 
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Foreword 

The project, "A Model for Acquisition and Selection of Career Education 
Instructional Materials," resulted in findings, conclusions, and recomenda- 
tions vhich should be helpful to information system planners and operators. 
Although regionaliisation of acquisition efforts did not prove feasible 
and more study is needed on selection procedures, new abstracting and 
indexing guidelines can be recommended. 

The efforts of the sub -contractor, the New England Resource Center 
for Occupational Education (NERCOE), should be noted. Appreciation is 
expressed to Dr. Ferucio Preschet, NERCOE project manager. Special 
acknowledgement should be accorded Mr. Dalton McAfee, graduate research 
associate, for his work in managing documents, collecting and analysing 
data, and preparing reports. 



Joel H. Magisos 
Project Director 
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INTRODUCTIOK 



Pfoblem 

Career education promises to be one of the most revolutionary changes 
to occur in public education during the second half of the Twentieth 
Century. It vill unify the curriculum around a career development theme 
and vrtll endeavor to provide each student with awarenes?, orieatatica, 
exploration, and preparation for a lifelong career congruent vith 
occupational opportunities, personal aspirations, and individual abil*'.ies» 

Implementation of career education requires new curriculum stra-cegies, 
re-deployment of extant instructional materials, and development of new 
materials New strategies are being developed in four USOE-sponsored 
models: the school -based comprehensive career education model, the 
employer -based model, the home-based model, emd the residential model. 
Initial work or* models has revealed the need for a system to obtain and 
select from among extant instructional materials appropriate to the 
objectives of the models. In addition, many educational practitioners 
engaged in in^lementing career education in local settings need materials. 
It was believed that many useful instructional materials had already been 
developed in state and local education agencies and institutions. Acquiring 
instructional materials fron these sources has been difficult for a variety 
of reasons, principal of which has been the lack of information on the 
natxire and whereabouts of these materials. 

Ptjrpose 

The purpose of the project was to test the efficacy of an intensive 
acquisition effort in one region of the Nation; and develop selection 
criteria, indexing strategies, and abstract formats congruent with user 
needs. 



Objectives 

a.:e specific objectives of the project which support the purpose vere; 

1. Acquisition of career education instructional materials fraa 
state-level and lot^l sources in the New England region (i.e., 
Connecticut, Maine, Massachusetts, New Itempshire, Rhode Island, 
and Vermont). Contributory objectives were— 

a. A definition of the expanded scope of the acquisition effort. 

b. Identification of sources of instructional materials in the 
region. 

c. A comparison of the acquisition yield in quantity and 
quality with known norms. 

2. Improved selection and description techniques. Contributory 
objectives included — 

a. Establishment of criteria to ensure appropriate input 
to the inforttiation system based on user needs. 

b. Development of indexing strategies to permit retrieval 
on the basis of potential use. 

c. Development of abstract formats which facilitate users' 
selection of materials for their use. 
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roOCEDURES 

Planned Metbodolomr 
The staff of The Center for Vocational and Technical Education (CVTE) 
was to develop an initial scope statement upon which to base acquisition 
of materials for the project, refining this statement after experience 
with the resultant input of instructional materials. The staff of the 
New England Resource Center for Occupational Education (NERCOE) was to 
develop a mailing list of potential sources of material and was to create, 
in cooperation with CVTE, acquisition announcements and request letters. 
CVTE and NERCOE were to jointly develop procedures for handling of acquired 
materials to assure their expeditious input to ERIC. The i >tial scope 
statement was developed by CVTE and cleared with NERCOE ar aOE/USOE 
(Appendix 1). NERCOE developed a mailing list of 5,600 New England 
educators. NERCOE 's David Roy and CVTE's Daryl EUsworth met to develop 
procedures for handling acquired materials (Appendix 2). 

NERCOE was to contact identified potential sources in successive 
mailings, through announctments in NERCOE and state agency newsletters, and 
directly by Kducational Information Consultants (NERCOE staff strategically 
located in the New England region). Over 5,600 New England educators were 
contacted with a form letter and reply card (Appendix 3). Follow-up letters 
were sent to ^,700 non-respondents and 200 respondents by NERCOE to acquire 
materials (Appendix U). 

CVTE was to work with a panel of informed, representative New England 
educators to establish initial criteria upon which to base selection from 
among acquired materials for input to the ERIC system. A second group of 
New England educators was to assess the resultant input and refine these 
criteria* The first panel was convened on December 8, 1972. The meeting 
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resulted in new "'Guidelines for Abstracting" and "Guideliiies for Indexing" 
(Appendix 5, 6). Other plans were developed to assess the results and are 
described below under "Necessary Changes." 

CVTE was to engage consultants to develop ir^'»xing strategies and 
abstract formats in the light of user needs ider xed by the first panel. 
These strategies and formats would be assessed by the second panel. Guide- 
Unes for indexing and abstracting (Appendix 5, 6' were instead developed 
by CVTE staff and were to be assessed in a controlled experiment involving 
the first panel. 

CVTE analyzed data on the acquisition and coapared it to norms estab- 
lished in past acquisition activity. CVTE analyzed acquisition data and 
conrpared it to previous acquisitions. Acquisitions from the New Englani 
region was not appreciably changed as a result of the project. 

CVTE and HERCOE were to prepare required progress and interim reports, 
and to prepare a final report which was to recommend the intensity of acquisi- 
tion effort, selection criteria, indexing strategies, and abstract formats. 
Resultant input of material was to become part of the national collection and 
be accessible and available to educators and others. NERCOE was expected to 
arrange for distribution of lists of project output to New England educators. 
The priraaxy responsibility for reporting fell on CVTE as the prljue contractor 
as CVTE kept records, analysed data, etc. A check with the NERCOE project 
manager was made each time, however. Materials acquired by the project were 
selected for inclusion in ASM, AIM, and RIE as appropriate. In the acquisition 
request, NERCOE proiilsed contributors that NERCOE would issue a catalog of 
acquired materials. 



Cooperative Arrangements 
CVTE had established a schedule for project events. Because of problems 
unique to the New England region, NSIC05 was later in its initial acquisition 



contact than had been planned. This resxatcd in delay in processing because 
materials were late. NERCOE did contact a large nurtber of New Englanders 
and followed up vigorously; in fact, at a greater level of effort than 
warranted by project funding. 

Necessary Chang s 

The late arrival of materials made it impractical to convene a second 
panel to review selection, abstracting, and indexing. It was decided to 
abort plans to meet with a second panel of New England educators in favor 
of another plan to serve project objectives. 

Bie new plans called for (l) the teleidjone interview of earlier panel 
members to get reactions to alternative abstracting and indexing techniques, 
(2) comparison of CVTE document selections to that of an expert consultant, 
and (3) an intensive study of the acquisition process with NERCOE's educa- 
tional information consxiltants. 

Review of Acquisitions 

CVTE personnel (i.e., project dire'iujr and research associate) met with 
NERCOE staff (i.e., project manager and educational information consultants) 
to review NERCOE's experiences in acquiring materials from state and local 
agencies. A list of questions were developed to guide the discussions 
(Appendix 7) and a summary ot the findings are incorporated in the Final 
Beport. 

Experljnental Comparis on of Abstracting and Indexing Techniques 

The telephone interview of the first panel included the following 
tasks: 

(1) Developaent of an abstract outline and index guidelines. 



(2) Develoiment of an interview sched le which would elicit the 
opinions of panel meaibers with request to old and new document 
treatment (abstracting and indexing). 

(3) Selection of five AIM documents that had already been Indexed 
and abstracted by old methods to receive new treatment. 

(k) Independent abstracting and indexing of the five AIM documents, 
using new abstract outline and index guidelines, 

(5) Contact of the first New England panel of educators to arrange 
for review of resumes and telejjhone interview, 

(6) Pairing, coding, formating, and sending of resumes to panel. 

(7) Conduct of telephone interviews with panel members using the 
interview schedule. 

(8) Compilation and analysis of data. 

Comparison of r>ft^iim«» nt Selection 

An expert consultant was coimnissloned during the final stages of the 
project to reselect 50 of the 109 documents acquired by NERCOE. Conparisons 
to determine the extent to which the expert independently selected documents 
for AM were conducted ard are reported in the findings. 
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FINDraOS, CONCUJSIONS, AND RECO^^^£EKDATIONS 
The procedxires, described in the previous section, vrere desicned to 
obtain findings upon vftiich to base conclusions ana reconmiendations. The 
raador purpose of the project was to test the efficacy of an intensive 
acquisition effort in one region of the Natic. • and to develop selection 
criteria, indexing strategies, and abstract formats congruent with user 
needs. In question was whether a national information clearinghouse 
(i.e., the ERIC Clearinghouse on Vocational and Technical Education) 
should employ the services of a regional agency (e.g.. New England Resource 
Center for Occupational Education) to sweep a region for state and locally 
developed instructional materials. Also at issue was whether existent 
selection criteria, indexing strategies, and abstract formats should be 
changed to better serve user needs. 

The intensive acquisition effort was conducted in six states (i.e., Con- 
necticut, Massachusetts, Maine, New Hampshire, Rhode Island, and Vermont) 
with the assistance of a sub-contractor, the New England Resource Center for 
Occupational Education (KERCOE). IIERCOS used the services of educational 
information consultants located in the states. The development of criteria, 
strategies, and formats was by project staff with the assistance of a panel 
of eight New England educators chosen by the NERCOE staff. Selection 
decisions by an expert consultant and the project staff were con^jared. 

Findings 

The findings presented in this section are based cn data collected 
during the course of project activities. Three means of data collection 
were employed: (1) tabulation of document nu^iibers, (2) questionnaire and 
telephone interviews, and (3) selection decision records. 
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Data are presented in tables as frequencies and totals of questionnaire 
and telephone interview items (Aj-pendix 8). The findings reported in this 
section are the basis of conclusions and recoramendatioas presented in 
following sections. 



Table I 

COMPARISON OF ACQUISITIONS BETWEEN 1971-72 AND 1972-73 



State 


Documents Acquired and Selected for AIM. 


ABM. 


or RIE 


1971-72* 


1972-7^ 


AIM 


ABM 


RIE 


Total 


AIM 


ABM 


RIE 


Total 


Connecticut 


7 


Ik 


0 


21 


3 


0 


1 


k 


Maine 


0 


k 


0 


k 


11 


0 


0 


11 


Massachusetts 


1 


20 


0 


21 


2 


1 


0 


3 


New Hajj^shire 


X 


k 


0 


5 


0 


1 


0 


1 


Rhode Island 


0 


1 


0 


1 


11 


1 


0 


12 


Vermont 


0 


0 


0 


0 


0 


0 


0 


0 


Totals 


9 




0 


53 


27 


3 


1 


31 


•Taken trm the f irs1 


three 


issues of AIM and ABM (1971-1972). 







Table I shows the number of documents acquired and selected in 19ri-?2 
as compared with the number of documents acquired in 1972-73, There were 
fifty-three documents acquired and selected for AIM, ARM, and RIE during 
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the year of 1971-72 as compared to only thirty-one acquired and selected 
for AIM, ARM, and RIE during the year of 1972-73, 

A panel of New England educators met with CVTE staff and suggested 
different content for abstracts. !Ehe CVTE staff developed a new abstract 
outline based on these suggestions. Five documents were selected randomly 
for independent treatment (i.e., re-abstracted, using the new outline). IHie 
new and old abstracts were placed in a questionnaire in random fashion for 
review by the eight panel menibers (Appendix 8). Banel members were to select 
the preferred abstract without knowing which method was represented in the 
abstract. 

Table II 
ABSTRACT SSI£iCTION 



Number of Document Old Method New Method 

Docinoent I 3 ? 

Document II 3 5 

Document III 3 5 

Document IV 2 6 

Docment V 3 5 

Totals lif 26 



Table II shows selections made by the eight respondents. Of the five 
documents, fourteen of the forty selections favored the old method; twenty- 
six favored the new method. 
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Table III 

cottiENTs commsum abstracting 



Compliioentary Comments 




Frequency 


Coonnents 


Old 


New 


- 


Method Method 


1* Include source of document 


6 


5 


2, More descriptive 


5 


5 


3. Very specific 


3 


8 


h» Vtore detailed 


3 


3 


5» Very complete 


3 


2 


6, Very concise 


3 


0 


7. Very well outlined 


2 


3 


8. Identifies grade level 


2 


1 


9* Contains sequential listings 


0 


5 


10. Others 


0 


0 



Total 26 35 



Taljle III shows the complljaentary comments made by the eight respon- 
dents concerning the old and new methods of abstracting. Of the fifty-one 
complimentary comments, twenty-six complimented the old method and thirty- 
five complimented the new method of abstracting. 
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Table IV 
CGrOOSNTS CONCERNXNG ABSTRACTING 





Critical Comments 


Method of Frequency 


Comments: 


Old 


New 






Method 


Method 


1. 


Very general 


6 


1 


2. 


Less descriptive 


5 


1 


3. 


Iisss detailed 


k 


0 


k. 


Omit sequential listings 


k 




5* 


Include source of document 


2 


2 


6* 


Too concise 


2 


0 


7. 


Too lengthy 


1 


2 


8. 


Abstract very vague 


1 


1 


9. 


Tbo specific 


0 


2 


10, 


Too complete 


0 


2 


11. 


Others 


0 


0 


Total 


25 


11 



Table IV shows the critical cooanents made by the eight respondents con- 
cerning the old and new methods of abstracting. Of the thirty-six critical 
comments, twenty-five criticized the old method, and eleven criticized the 
new method of abstracting. 



Using the same methods as fcr abstracting, new and old Indexing 
strategies were applied to each of the five pandomly-selected dociiments. 
The questionnaire required that the eig^bit panelists choose a preferred 
index set* 

Table V 
SELECTION OF m>EK TERMS 



Number of Document Old Miethod New Miethod 

Document I 0 8 

Document II 3 5 

Document III 3 5 

Document IV k k 

Document V 3 3 

Totals 13 27 



Table V shows selections by the ei^t respondents* Of the five docu- 
sients, thirteen of the forty selections favored the old method; twenty- 
seven favored the new method* 
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Table VI 



Compliiuentary Comments 


Method of Frequency 


CoDsoents 


Old 


New 




Method 


Method 


!• More comprehensive 


2 




2. More descriptive 


2 


6 


3. Very complete 


2 


3 


if-. Very useful 


1 


2 


5« Verv clear 


1 


3 


6. Very concise 


1 


3 


7* Relevant to abstract 


1 


k 


8* Include grade levels 


1 


k 


9* Others 


0 


0 ~ 


Totals 


11 


29 



Table VI shows the cosapllmentary comments made hy the eight respondents 
concerning the old and new methods of indexing. Of the forty coraplireentaxy 
conaents concerning indexing, elevt-n complimented the old method and twenty- 
nine canplimented the new method of indexing. 
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Table VII 
COMMENTS CONCERNING INDEma 



uritxcax Commenvs 


Method of Frequency 


Cossmenta: 


Old 


New 




Method 


Method 


1* Too general 


6 


2 


2. Terms too vagae 


3 


2 


3. Very misleading 


o 


C 


U» Too specific 


2 


1 


5- Omit grade levels 


1 


1 


6» Terms are limited 


1 


1 


7. Less descriptive 


1 


0 


8, Exclude grade levels 


1 


0 


9. Irrelevant to abstract 


1 


0 


10. Others 


0 


0 


Totals 


17 


9 



Tahle VII shows the critical coiaoents made by the ei^t respondents 
concerning the old and new methods of indexing. Of the twenty-six critical 
comments, seventeen criticised the old method, and nine criticized the new 
method of indexing. 
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The 109 dociatients acquired in the project were processed along with 
other documents acquired by CVTl-: with no special considerations. Abstracting 
and indexing were routinely performed after selections were made using 
regular CVTE criteria. The re-abstracting and re-indexing of five randoraJy- 
selected documents was for the purpose of testing the desirability of 
using new abstract formats and indexir^g strategies. 

The selection decision of the CVTE staff was compare* with independent 
selection of 50 documents randomly selected from among the 109 project 
documents by a knowledgeable expert (Mr, Jay Wood, Administrator, Program 
Develoiment, State Coordinating Council for Vocational Education, Olympia, 
Washington). Table VIII shows the comparisons. 

Table VIII 
COIPARISON OP SEIfiCTIOKS 



The Accession Number 
of Documents 


CVTE StafT 


Knowledgeable Expert 




Selected 


Rejectee? 


Selected 


Rejected 


1 


X 






X 


3 




X 


X 




k 




X 


X 




5 




X 




X 


9 




X 




X 


10 




X 


X 




11 




X 


X 




12 




X 




X 


13 




X 


X 




16 


X 




1 

1 


X 
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The Accession Nuniber 
of Documents 


CVTE Staff 


Knowledgeable Expert 




Selected 


1 Rejected 


Selected 


1 Rejected 


X7 


1 V 
1 ^ 




X 






20 


1 X 




X 






21 


A 




X 






22 


1 IT 
1 ^ 




X 






Zk 


1 V 
1 ^ 




X 






25 


1 ^ 




X 






26 


1 A 






1 ^ 




29 


1 V 
1 ^ 




X 






31 




1 V 
1 ^ 


X 






33 




X 


X 






3h 


X 




X 






35 


1 A 






X 




53 


A 




X 






57 


X 




X 






58 


X 




X 






62 


A 




X 






73 




X 


X 






75 


X 




X 1 






76 


X j 




X 1 






77 


X 




X 






78 


X 




X 






79 


X 






X 




80 


X 




X 






81 


X 




X 
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The Accession Nunber 
of Documents 


CVTE Staff 


Knowledgeable EjQ)ert 


Selected 


Rejected 


Selected 


Rejected 


82 




X 




X 


83 




X 


X 








X 




X 


87 




X 




X 


88 


X 






X 


92 


X 






X 


93 


X 






X 


Sk 


X 




X 




95 


X 




X 




100 




X 




X 


101 




X 




X 


102 




X 




X 


103 




X 




X 


108 




X 




X 


109 




X 


X 




67 


X 




X 




Totals 


29 


21 


30 


20 



It is interesting to note that total selections were 29 by staff and 
30 by the expert. There were differences in specific selections. The 
expert disagreed vlth CVTE staff selections in 18 of the 50 cases coi^pared. 
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In spite of difference in selection decisions by expert and CVTE staff, 
the rate of rejection was nearly the same. The selection-rejection fre- 
quencies are shown in Table IX. 



Table DC 

SELECTION OF DOCUMENTS FOR IKCIUSION 



Selection Niuaber of 

Decision Docunents I^rcentage 

Selected for inclusion 

in systems ^4 l^^.^ 

Rejected 55 50.5 



The rejection of 50.5 percent of the documents acquired in the New England 
legion exceeds the average system rejection of 30 percent by a notable 
amount. 

Conclusions 

Based on the findings, several conclusions can be drawn relative to 
acquisition, selection, abstracting, and indexing. 

1. Intensive acquisition efforts conducted on regional basis 
involving an intermediary aigehcy is not cost-effective . 
efficient,, or productive . 

Evidence for this condiision is based on comparisons between 
1971-72 and 1972-73 and shown in Table I of the Findings . 
This was sup(ported in discussions with the NERCOE project 
manager and educational information consultants* 
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2« More study is needed on selection criteria and larocedures ^ 

Differences in the selections oy CVTE staff and a know- 

ledgesOJle expert vrere large enou^ to conclude that there 

is reasonable doubt about the reliabUity of selection 

criteria or that practitioners (represented by the eacpert) 

needs are not being met by CVTE staff selections, 

3» Use of nev "Guidelines for Abstracting" (Appendix 5) on 
instructional materials is desirable . 

The panel of New England educators favored abstracts 

resulting from use of new guidelines as shown in 

Table II. They chose new abstracts more frequently; 

they had more ccanpliiaentary comments and fever critical 

comments about new abstracts (Table III and IV). 

^- Use of new "Guidelines for Indexing;' (Appendix 6) on 
instructional materials is desirable . 

New England educators chose sets of index terms resulting 

from use of the new guidelines more frequently (Table VI). 

They had more complijnentary comments (Table VII) and fewer 

critical comments (Table VIII) about set index terms 

resulting from the new guidelines. 

Recommendations 

Recommendations resulting fran the project are based on the findings 
and conclusions. 

1. It is recommended that the acqixlsition of instructional and 
other materials for a national information system, such as ' 
ERIC or AIM and ARM, continue to be centralized as in the " 
past . ~~ 

This recommendation is based upon the conclusion that use 

of an intermediary agency in acquisition is not cost-effective, 

efficient, or productive. Both CVTE and NSRCOE observers 
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agree upon this conclusion end the acquisition yield seems 
to corroborate the conclusion. 

It is re comroended that & study be undertaken to determine 
If and why information system staff menibers differ in 
their selection of documents from that of practitioners . 

Only one expert consxatant was used to check CVTE staff 

selection decisions. Although both selectors selected 

the same number of documents, there was disagreement 36 

percent of the time. It can be speculated that either 

the criteria were unevenly applied or that the criteria 

lacked reliability. It also could be speculated that the 

criteria were inapproprif.te to the needs of the user. 

?feeded is a study which would result in a validated set 

of criteria based on user needs. 

It is recommended that new 'Guidelines for Abstracting" 
and Guidelines for Indercing ' be adapted for use in 
abstracting and indexing Instructional aaterleas . 

Althou^ further evidence through a replication of the 

study is needed, there seems to be sufficient evidence 

that the new guidelines should be used to abstract and 

index instructional materials. 

It is recommended that the study of user preferences for 
abstracts and Index term sets be replicated with other 
subjects and in other regions ! 

A replication of the abstract and Index set comparisons Is 
needed, primarily because the study sub^Jects were the saae 
individuals that served on the panel that made input to 
the guidelines. Further, there may be differences between 
regions. 
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The project, "A Model for Acquisition and Selection of Career Education 
Instructional Materials," resulted In several useful reconaaendations. 

Intensive efforts by a regional agency to acquire inatractional 
materials for a national information systoa proved to be costly and ineffec- 
tive in cooparison to direct effort by the central Clearin^ouse . 

Project activity left the question of selection criteria still much in 
doubt. Selection of documents by an expert consultant and the CVTB staff 
were at the same rate (e.g., nuniber selected, nuniber rejected), but 
notably different with respect to specific documents. Further study is 
needed In the area of selection to meet user needs. Two questions must be 
answered: (l) Are user needs for materials Incongnient with selection 
criteria, and (2) how, If Incongruent, should criteria and procedures for 
selection be changed? 

Changes in abstract formats and indexing strategies may be made with 
some confidence that changes will better serve users. 

Lastly, the few documents collected as a result of the project activity 
contribute to the total collection. 
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APPENDIXES 



APHSKDIX 1 

8/3/72 

A MODEL FOR ACQUISITION AND SELECTION OF 
CAREER EDUCATION INSTRUCTIONAL MATERIALS 

Scope of Acquisition 
The mission of the project is to acquire materials \#hich contribute 
to the developnent of educational programs focusing upon the career 
developnent of individuals at all levels, pre -school throu^ adulthood. 
Most of these programs will be based in schools, but may include those 
which interplay with community and local industry, leading toward 
productive employment of the student. Within the scope are programs 
infused with concepts and practices idiich advance individuals throu^ 
stages of career awareness, ejcploration, and preparation for a full 
range of careers. These programs may include a wide variety of tradi- 
tionally academic subjects such as mathematics, English, social studies, 
or science, and all areas of vocational and practical arts education. 
Materials may include textbooks, curriculum guides, study guides, 
teaching guides, program guides, resource material, audiovisual aids, 
student handboolcs, research reports, conference proceedings, bibliographies 
dissertations, guidance manuals, and interpretive papers. 
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APPENDIX 2 



Cra/KERCOS 
Acquisition Procedures 



I. IimiOD"CTION 



NERCQE has subcontracted with CVTE to undertake the pro;Ject of 
accpiiring career education instructional materials developed in the 
six New England states of Connecticut, Massachusetts, Maine, ITew 
Hj^pshire, Rhode Island, and Vermont. This activity will be accon- 
pUshed ly the intensive efforts of three state-based Educational 
Information Consultants (BlC's). 

^ prevent overlap of scope in this acquisition effort, 
cm agrees to discontinue efforts of acquiring instructional materials 
in this area until April, 1973 and wiU transfer all leads to 
instructional materials to NERCOB. CVTE will continue efforts in 
obtaining research materials. Any research documents acquired by 
the EIC's in the course of normal contacts will be given to CVTE. 



II. COMTACT PROCEDURES 

The initial contact vill be made by mail (see attached sample of 
initial letter). The audience contacted will be determined by JJERCOE's 
mailing list of educators throu^out New England in conjunction with a 
list of educators supplied by CVTE. Each EIC will also make telephone 
and personal contacts within his own states. Appropriate follow-up 
procedures will be conducted by the EIC 's or NERCOE as necessary. By 
asking a question such as "are any of your colleagues involved in a 
similar career education project?", the EIC will be able to expand his 
contact lists. In the event an SIC receives a lead on materials located 
outside the New England states, he will forward this information to CVTE 
by means of an informal memo to Mr. Daryl Ellsworth. 



III. ACqyiRING MATERIAI5 

?f request three copies of pertinent documents which have 

been identified. Two copies will be forwarded to CVTE for possible 
inclusion in the ERIC system and one copy will be housed at KERCOE." if 
two copies are obtained, each center will receive one. If only one 
copy is made available, NERCOE will either make a second copy xod forward 
i^original to CVTE, or will forward the original with a request that 
CVTE re^oduce the document for NERCOE, within the budgetary lljaitations 
for co;^ylng. 

V, ^^■^^ ^® complimentary copies. Generally, commercially 

published materials will not be included in the search effort, but will be 
considered for ERIC if a copy is provided on a complimentary basis. Any 
document which is obtained that contains a cppyri^t statement will be 
processed in the following maimer: 
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The SIC will determine if the doc\ment is available for sale. If 
the document is sold, NERCOE will forward the complimentary copy(s) 
to CVTE with a statement showing cost, agency where available, 
and address. CVTS assumes full responsibility for securing 
copyright releases for ERIC input. If complimentary copies 
are not made a-milable, a listing will be generated and forwarded 
to CVTB for future consideration of purchase. 

In all cases the EIC vrf.ll atterairt; to secure up to three documents. If f 
an agency indicates that it has already forwarded a particular document to 
CVTE, the EIC will secure one document for the NERCOE Clearinghouse if 
possible. In any event, the SIC should secure a citation of the document 
to be forwarded to CVTE for duplicate check. 

Should the EIC encounter any nonprint materials (audiovisufil materials) 
which are available for seae . he should attempt to secure one copy of the 
item with appropriate information for purchase. This wiH be forwarded to 
CVTE for possible inclusion in the ERIC system. 



IV. COSMUNICATIOHS 

Basically, all co m m u nications will be conducted between CVTE/NERCOE 
and NERCOE/EIC, Should the need arise for an EIC to camunicate directly 
with CVTE, the EIC will inform KERCOE of the date, time and telephone 
number of where he should be contacted. NERCOE will relay this message 
to CVTE who in turn will contact the EIC. 



V. SHIiMENTS OP DOCUMENTS 

Shipments of acquired documents will be made to CVTB during the 
first week of each month througjiout +he contract period. The shipoent 
will be divided into three sections, separating the documents obtained 
by each EIC, Each section of every shipment will include a label with 
the following information: 

1 . Identification of EIC /state (s ) 

2. P&clcage number 

3» Nuffliber of items included 

If the document does not contedn complete bibliographic data (title, author, 
agency or source, date, number of pages, etc.) the EIC or NERCOE will attempt 
to obtain this prior to shipment to CVTE. A note should be attached to each 
doctiment showing the name and address of the contributor in order that CVTE 
may be able to respond to the contributor concerning the process of the 
document. 



VI. REPORTS 

On a quarterly basis, NERCOE will forward to CVTE a report of the nuitfber, 
type, and Imown response of contacts made by mail, phone, and personal visits, 
along with other pertinent data. The format and style of records required for 
NERCOE reports to CVTE will be as decided by NERCOE, with the minlMim data 
being a statistical summary, by state, of the contacts made and the nature of 
responses. An interim and final report format will be developed at a later 
date. 
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APPENDIX 3 



New England 

Resource Center 

for Occupational Education 

.It E D C ■?■> Chopt'l St.. Newton. Mjss. 02^H) 
(617) 969-7100 Cable NFRtOE 



Oeor Educotor: 

Career education promises to be one of the most revolutionory changes to 
occur in public education during the second half of the 20th century, it 
will unify the curriculum around o career development theme and wiSl 
attempt to provide each student with awareness, orientation, exploration, 
and prepoH'ation for a wider range of career options than ever before 
possible. 

Not only will career education be focusing on all ages, pre-schooi 
through aduhhood, but the concepts will appea* In a variety of 
experiences — traditional academic subjects such as mathemotlcs, 
English, social studies, or science, as well as all areas of vocational 
and practical arts education. 

NERCOE is Initiating a special effort to acquire Instructlonol materials, 
previously unpublished. In the growing field of Career Education. 
Curriculum guides, study guides, research reports, audiovisual aids, 
conference proceedings, bibliographies, guidance manuals. Interpretative 
papers, even dissertations will be collected. 

Al though the enclosed flyers (which we hope you will post) encouroges 
educators to contact us regarding this project, we feel It is important thot 
NERCOE hove a list of potential contributors that we may contact directly. 

Therefore, we would appreciate your returning the enclosed card with the 
names of Individuals you are acquainted with, who have developed, 
adopted, or adapted career education materials. 



Cordially, 




Ferucio Freschet 
Director of Informotion Services 
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POST CARD RETURN 

TO: PROJECT SEEK 

FROM: Name 

Address of Institution 

Please list the names of individuals within your system who have 
information regardinvi instructional materials in Career Education 
that they may want to contribute to this collection. 

Name 

Tel. No. 

Title 

Address 

Name 

Tel . No. ; 

Title 

Address 

Other _ _^ 

Sorry, I cannot provide you with any leads for instructional 

materials on Career Education. 
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New Enghnd 

Resource Center 

for Occupational Education 

.11 E D C •» » Chapel Sr. Newion. Ntass. 021f.O 
(617) %<*-riOO Cable NERCOl 




Dear EciucQtor: 
Hello: 

I've looked oil over my desk, but I con't locate o reply from you to our letter 
sent during the week of January 8th concerning the ocquisttion of career 
education moterlols. 

If you recall, we are specifically interested in acquiring career education 
Instructional moterials in any'subiect oreo or at any level so long os they help 
to odvonce individuals through stages of awareness, exploration, and prepara- 
tion for o full range of careers. 

Your response on the enclosed reply cord (which asks tor the names of individuals 
who moy possess such materials) will be most helpful to us. 



s 



A Product Catalogue, listing availoble career education Instruction material 
collected from this search will be made avoiloble to you upon request. 

Cordially, 

Ferucio Freschet, Director 
Informotion Services Program 



If you hove any questions or special concerns about the pro|ect, NERCOE's 
representative. Lorry Brown, will be happy to assist you. He con be reached 
at PROJECT SEEK, 55 Chapel Street, Newton, Massachusetts, or phone 
(617) 969-7100 Ext. 386. 
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APPENDIX 5 



Guidelines for Abstracting 



The 200 word abstract should contain core elements of 
information so that the reader can evaluate the pertinence 
aiid usefulness of the document for his own situation. To 
ensure space and permit ease in reading, phrases rather 
than complete sentences may he used. Direct language and 
simple statements are recomnended; this need not he a 
literary masterpiece. Justifiable evaluative statements 
may he tused. 

The abstract should contain the following information 
if available: 

1. Credibility or essperience of developer 
(if not apparent); resources used, 

2. Amount and level of testing and/or 
usage* 

3. Difficulty of adopting (e.g., cost, 
curriculum changes, special training) 

Objectives and content. 
5. important items i*hich cannot be indexed. 
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APEBIOIX 6 



CSuldellnes for Indexing 



Instructional materials to be utilized by practitioners should 
have at least one irdex term representative of each of the following 
categories: 

*1# Subject field • the field or fields of education in 
which this material would normaTly be utilised (e.g., 
agricultural education, office occi^tions education, 
industrial arts, mathematics education). 

*2. Career field - the oco^tional field(s) or specific 
occupation(s) for ^ch these materials may be utilized 
(e.g., service occupations, nursing, teaching, carpenters). 

*3. Stage of career developaent - specificity of career 

information (e.g., career awareness, career easploration, 
career preparation). 

if. Career activities - student activities related to career 

developacnt (e.g., field trips, role playing, writ ea^erience 
programs). 

level of Student - grade or age level (e.g., adult education. 
Grade k, secondary grades, post-secondary education). 

*6. Use of materials - Purpose for which materials were designed 
(e.g., study guides, teacher education, teaching guides). 

7. Content of document - additional items of Importance 
which should be reflected in the index terms (e.g., 
tests, bibliographies, tables, lesson plans). 
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APPENDIX 7 

QUESTIONS FOR PANEL MEETING 

Date: May 8, 1973 

^* letter to state director s from CVTE seeking cooperation 

a. Did the state directors cooperate? 

b. Did the EIC's visit each state director? 

c. What were the concerns exiaressed by state directors? 

d. vniat did the state director do to facilitate acquisition? 

e. What obstacles did he create? (i.e., special requirements, 
constraints, protocols) 

f . Is legitimization by the state director necessary or 
desirable? 

^""^"^ ^' Letter and reply card to 5 600 New England educators to solicit 
materials and gain leads ^ «»oxxcxTi 

a. How many answered the request? 

b. How many items resulted from the first approach? 

c. Principally, why wasn't there a better response rate? 

d. How could initial contact be improved? 

^""^^^ ^* Fo3Jow>up le tter to 20h referrals hv wr gRCOE to acquire materials 

a. What percentage resulted in materials? 

b. What was the reaction of contributors? 

c. What percentage of leads resulted in materials? 

Event k. Follow-up letter to i^QQQ na n^respondents to elicit a response 

a. What percentage of non-respondents finally responded? 

b. Why hadn't they responded earlier? 

c. How were the non-respondents different than initial respondents? 

d. How many non-respondents finally submitted materials? 
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Event 5. Distribution of news items pn the prelect 

a. How many articles appeared to solicit materials in 

1. NERCOE's newsletter 

2. State newsletters 

3. Other newsletters 

b. Could we get copies of these articles for the final report? 

Event 6. EIC contacts in states 

a. How many and what contacts were made at the state level? 

b. How many and what contacts were made at the local level? 

c. How productive were these contacts in terms of materials 
acquired? In terms of other benefits? 

Event 7. General questions 

a. Is this much effort worthwhile? 

b. What could ^<ave been done better? 

c. Would this work less well or better in another region? 

d. What is the state-of-the-art in curriculum development in 
New England? 

e. Is there material at the state and local levels that we 
failed to get? 

f. Why didn't we get most of the materials? 

g. What should be done next? 
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AHPENDDC 8 



INTERVIEW SCHEDULE 



Naioe 



Address 

Fbone 

Date 

Tlm # 

This is 

Education in Columbus, OhioT 



at The Center for Vocational and Technical 



Establish purpose 

a. We sent you some materials last week. Did jrou receive them? 



b. 

c. 
d. 



If jes proceed. If no, express a sense of urgency by explaining 
that you will send a second set, AIR MIL - SPECIAL DELIVERY. 
Obtain exact, best address. Schedule another telei>hone call. 

Do you have the material with you? 

If yes, proceed. If no, arrange to call back. 



Questions - keep records on duplicate set for each respondent, 
a. Let's start with Document 1. 

Which abstract do you like best, a or B? 
Why do you like (A or B)? 
Why don*t you like (A or B)? 

Which set of index terms do you like best, A or B? 
Why do you like (A or B)? 
Why don't you like (A or B)? 
Now, let's consider Document 2. 



b 
c 
d 
e 
f 
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